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plexer has frontend logic, a packet buffer, and data, video, 
and audio unloaders. The front end logic receives transport 
stream input packets, and delivers the transport stream 
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TRANSPORT DEMULTIPLEXOR FOR AN 
MPEG-2 COMPLIANT DATA STREAM 

FIELD OF THE INVENTION 

This invention relates to digital delivery systems, espe- 
cially for digital video and digital audio data. More 
particularly, the invention relates to multiplexors, networks, 
distribution systems, demultiplexers, and multiplexed 
bitstreams, and especially to bitstreams carrying a system or 
transport layer, and one or more data layers of compressed 
digital video and digital audio data. More particularly, the 
invention relates to demultiplexing the incoming bitstream 
to recover video data, audio data, and such system data as 
program clock references, packet id's, and the like, in real 
time. 

BACKGROUND OF THE INVENTION 

Within the past decade, the advent of world-wide elec- 
tronic communications systems has enhanced the way in 
which people can send and receive information. Moreover, 
the capabilities of real-time video and audio systems have 
greatly improved in recent years. Real-time video and audio 
systems require a large bandwidth. In order to provide 
services such as video-on-demand and videoconferencing to 
subscribers, an enormous amount of network bandwidth is 
required. In fact, network bandwidth is often the main 
inhibitor to the effectiveness of such systems. 

In order to minimize the effects of the constraints imposed 
by the limited bandwidths of telecommunications networks, 
compression systems and standards have evolved. These 
standards prescribe the compression of video and audio data 
and the delivery of several programs and control data in a 
single bit stream transmitted in a bandwidth that would 
heretofore only accomodate one analog program. 

One video and audio compression standard is the Moving 
Picture Experts Group ("MPEG") standard. Within the 
MPEG-2 standard, video compression is defined both within 
a given picture, i.e., spatial compression, and between 
pictures, i.e., temporal compression. Video compression 
within a picture is accomplished by conversion of the digital 
image from the time domain to the frequency domain by a 
discrete cosine transform, quantization, variable length 
coding, and Huffman coding. Video compression between 
pictures is accomplished via a process referred to as motion 
compensation, in which a motion vector is used to describe 
the translation of a set of picture elements (pels) from one 
picture to another. Audio compression is as defined in the 
MPEG-2 Standard. 

The procedure for transporting the compressed bitstream 
from the transmitting end to the receiving end of the system, 
and for thereafter decompressing the bitstream at the receiv- 
ing end, so that one of the many picture sequences is 
decompressed and may be displayed in real-time is specified 
in ISO 13818-1. ISO 13818-1 is the systems or transport 
layer portion of the MPEG-2 standard. This portion of the 
standard specifies packetization of audio and video elemen- 
tary bitstreams into packetized elementary streams (PES), 
and the combinations of one or more audio and video 
packetized elementary streams into a single time division or 
packet multiplexed bitstream for transmission and the sub- 
sequent demultiplexing of the single bitstream into multiple 
bitstreams for decompression and display. The single time 
division or packet multiplexed bit stream is as shown from 
various architectural and logical perspectives in the 
FIGURES, especially FIGS. 1 to 5, where many packets 
make up a single bitstream. 
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The concept of packetization and the mechanism of 
packet multiplexing are shown in FIG. 1, denominated 
"Prior Art", where elementary streams are formed in an 
audio encoder, a video encoder, a source of other data, and 

5 a source of systems data. These elementary streams are 
packetized into packetized elementary streams, as described 
hereinbelow. The packetized elementary streams of audio 
data, and video data, and the packets of other data and 
systems data are packet multiplexed by the multiplexor into 
a system stream. 

The time division or packet multiplexed bitstream is 
shown, for example, in FIGS. 5 and 2, both denominated 
"Prior Art", which give an overview showing the time 
division or packet multiplexed bitstream. The bitstream is 
comprised of packets, as shown in FIG. 5. Each packet, as 

15 shown in FIG. 2, is, in turn, made up of a packet header, an 
optional adaptation field, and packet data bytes, i.e., pay- 
load. 

The MPEG-2 System Layer has the basic task of facili- 
tating the multiplexing of one or more programs made up of 

20 related audio and video bitstreams into a single bitstream for 
transmission through a transmission medium, and thereafter 
to facilitate the demultiplexing of the single bitstream into 
separate audio and video program bitstreams for decompres- 
sion while maintaining synchronization. By a "Program" is 

25 meant a set of audio and video bitstreams having a common 
time base and intended to be presented simultaneously. To 
accomplish this, the System Layer defines the data stream 
syntax that provides for timing control and the synchroni- 
zation and interleaving of the video and audio bitstreams. 

30 The system layer provides capability for (1) video and audio 
synchronization, (2) stream multiplex, (3) packet and stream 
identification, (4) error detection, (5) buffer management, 
(6) random access and program insertion, (7) private data, 
(8) conditional access, and (9) interoperability with other 

35 networks, such as those using asynchronous transfer mode 
(ATM). 

An MPEG-2 bitstream is made up of a system layer and 
compression layers. Under the MPEG-2 Standard (ISO/IEC 
13818-1) a time division or packet multiplexed bit-stream 

40 consists of two layers, (1) a compression layer, also referred 
to as an inner layer, a payload layer, or a data layer, and (2) 
a system layer, also referred to as an outer layer or a control 
layer. The compression layer or inner layer contains the data 
fed to the video and audio decoders, and defines the coded 

45 video and audio data streams, while the system layer or outer 
layer provides the controls for demultiplexing the inter- 
leaved compression layers, and in doing so defines the 
functions necessary for combining the compressed data 
streams. This is shown in FIG. 3, denominated "Prior Art." 

50 As there shown a bitstream of, for example, a system layer 
and compression layer, is the input to a system decoder. In 
the system decoder the system layer data is demultiplexed 
into the compressed audio layer, the compressed video layer, 
and control data. The control data is shown in FIG. 3, 

55 denominated Prior Art, as the PCR (Program Clock 
Recovery) data, enable data, and start up values. The com- 
pressed data is sent to the respective audio and video data 
buffers, and through decoder control to the respective audio 
and video decoders. 

60 The system layer supports a plurality of basic functions, 
(1) time division or packet multiplexing and demultiplexing 
of the time division or packet multiplexed multiple bit- 
streams, (2) synchronous display of the multiple coded bit 
streams, (3) buffer management and control, and (4) time 

65 recovery and identification. The system layer also supports 
(5) random access, (6) program insertion, (7) conditional 
access, and (8) error tracking. 
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For MPEG-2, the standard specifies two types of layer vision channels or television programs, where each' indi- 

coding, a program stream (PS), for relatively lossless vidua! program can have its own time base, and each stream 

environments, such as CD-ROMs, DVDs, and other storage making up an individual program has its own PID. Each 

media, and transport stream (TS), for lossy media, as cable separate individual program has one or more elementary 

television, satellite television, and the like. The transport 5 streams (ES) generally having a common time base. To be 

stream (TS), shown in FIG. 2 and denominated Prior Art, notcdi ^ ^ whilc not illustrated in the FIGURES, different 

consists of a stream of transport stream packets, each of transport streams can be combined into a single system 

which consist of :188 bytes, divided into 4 bytes of packet t rt Elcmcntary strcam (es) data, that is, 

header of packet ^ header, an opUonal adaptation field, and up access ^ (AU) afe first enc lated mt0 packe ti Z ed 

to 184 bytes of me ^ elementary stream (PES) packed which are" in turn. 

The relationship of the layering of the access units, the PES , . . ; # _> ' V™ x * . . . * 

packets, and the Transport StrTam (TS) packets is shown in f\ ert ed transport stream (TS) packets, as shown m FIG. 

FIG. 5, denominated Prior Art. 5, denominated Pnor Art 

The transport stream (TS) is used to combine programs H« architecture of the transport stream (TS) packets 

made up of PES-coded data with one or more independent under the MPEG-2 specifications is such that the following 

time bases into a single stream. Note that under the MPEG-2 15 operations are enabled: (1) demultiplexing and retrieving 

standard, an individual program does not have to have a elementary stream (ES) data from one program within the 

unique time base, but that if it does, the time base is the same transport stream, (2) remultiplexing the transport stream 

for all of the elements of the individual program. , witn onc or more programs into a transport stream (TS) with 

The packetized elementary stream (PES) layer is an inner a sin S le P r °g ram > (3) extracting transport stream (TS) pack- 
layer portion of the MPEG-2 time division or packet mul- 20 cls ^m different transport streams to produce another 
tiplexed stream upon which the transport or program streams transport stream (TS) as output, (4) demultiplexing a trans- 
are logically constructed. It provides stream specific P ort strcam CTS) P ackct onc program and converting it 
operations, and supports the following functions: (1) a mto a program stream (PS) containing the same program, 
common base of conversion between program and transport c ( 5 ) converting a program stream (PS) into a transport 
streams, (2) time stamps for video and audio synchroniza- 25 stream f 1 ^) to carrv il over a loss y medium to thereafter 
tion and associated timing, especially for associated audio recovcr a vaUd Program stream (PS), 
and video packets making up a television channel, At the transport layer, the transport sync byte provides 
presentation, or program, and having a common time base, packet synchronization. The Packet Identification (PID) 
(3) stream identification for stream multiplexing and field data provides packet identification, demultiplexing, and 
demultiplexing, and (4) such services as scrambling, VCR 30 sequence integrity data. The PID field is used to collect the 
functions, and private data. packets of a stream and reconstruct the stream. The conti- 

As shown in FIG. 5, denominated Prior Art, video and nuity counters and error indicators provide packet sequence 
audio elementary streams (ES) must be PES-packetized integrity and error detection. The Payload Unit start indica- 
before inserting into a transport strcam (TS). Elementary tor and Adaptation Control are used for payload 
streams (ES) are continuous. PES packets containing an synchronization, while the Discontinuity Indicator and Pro- 
elementary stream (ES) are generally of fixed lengths. gram Clock Reference (PCR) fields are used for playback 
Typically, video PES packets are on the order of tens of synchronization. The transport scramble control field facili- 
thousands of bytes, and audio PES packets are on the order tales payload descrambling. Private data transfer is accom- 
of thousands of bytes. However, video PES packets can also P^ed through the Private Data Flag and Private Data 
be specified as of undefined length. Bytes. The Data Bytes are used for private payload data 

The MPEG-2 packetized elementary stream (PES) packet transfer > m <* ^ Stuffin S B y tes are **** t0 round out a 

structure is shown in FIG. 4. To be noted is that all of the packet. 

fields after the PES packet length are optional. The PES A transport stream is a collection of transport stream 
(packetized elementary stream) packet has a PES header, an 45 packets, linked by standard tables. These tables carry Pro- 
optional header, and payload. The PES header has bit start gram Specific Information (PS!) and are built when a 
code, a packet length field, a 2 bit "10" field, a scramble transport stream is created at the multiplexor. These tables 
control field, a priority field, a data alignment field, a copy completely define the content of the stream. 1\vo of the 
field, a PTS/DTS (Presentation Time Stamp/Decoding Time tables of the transport stream are the Program Association 
Stamp) field, a field for other flags, and a header length field. 50 Table (PAT) and the Program Map Table (PMT). 

The "Optional Header" field includes a Presentation Time The Program Association Table is a table of contents of 

Stamp field, a Decoding Time Stamp field, an elementary the transport stream. It contains an ID that uniquely identi- 

stream clock reference field, a elementary stream rate field, fies the stream, a version number to allow dynamic changes 

a trick mode field, a copy info field, a Prior Packetized of the table and the transport stream, and an association table 

Elementary Stream Clock Recovery field, an extension, and 55 of pairs of values. The pairs of values, PN, and PMT-PID, 

stuffing. are the Program Number (PN) and the PID of the tables 

The packet start code provides packet synchronization. containing the program. 

The stream ID field provides packet identification. Payload The Program Map Table is a complete description of all 

identification is also provided by the stream ID. The PTS/ of the streams contained in a program. Each entry in the 

DTS flag fields and the PTS/DTS fields provide presentation eo Program Map Table is related to onc and only one program, 

synchronization. Data transfer is provided through the The role of the Program Map Table is to provide a mapping 

packet/header length, payload, and stuffing fields. .The between packets and programs. The program map table 

scramble control field facilitates payload descrambling, the contains a program number that identifies the program 

extension/private flag fields and the private data fields within the stream, a descriptor that can be used to carry 

provide private information transfer. 65 private information about the program, the PID of the 

A transport stream (TS) may contain one or more packets that contain the synchronization information, a 

independent, individual programs, such as individual tele- number of pairs of values (ST, Data-PID) which, for each 
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stream, specify the stream type (ST) and the PID of the clear need for transport demultiplexers that can extract 

packets containing the data of that stream or program program clock references (PCRs) from the data stream and 

(Data-PID). filter out unnecessary components through the use of Packet 

There is also a Network Information Table used to provide Ids (PIDs). A further need exists for transport demultiplexers 

a mapping between the transport streams and the network, 5 to support additional processing and parsing functions to 

and a Conditional Access Table that is used to specify minimize the load on the host processor, such as clock 

scrambling/descrambling control and access. recovery, table filtering, and error detection. 

In use, the tables are used to select and reconstruct a ORiFrrs of thf iisrvFNrrrnM 

particular program. At any point in time, each program has OBJECTS OF THE INVENTION 

a unique PID in the Program Map Table. The Program Map 30 it is a primary object of the invention to demultiplex the 

Table provides the PIDs for the selected program s audio, incoming data stream according to the embedded instruc- 

video, and control streams. The streams with the selected tions in the System Layer, breaking the data stream into 

PIDs are extracted and delivered to the appropriate buffers individual components that are passed to an audio decoder, 

and decoders for reconstruction and decoding. a video decoder, or system memory. 

Achieving and maintaining clock recovery and synchro- 15 It is a still further object of the invention to extract 

nization is a problem, especially with audio and video program clock references (PCRs) from the data stream, 

bitstreams. The MPEG-2 model assumes an end-to-end filtering out unnecessary streams through the use of Packet 

constant delay timing model in which all digital image and . id s (PIDs). 

audio data take exactly the same amount of time to pass It is a stm mrthcr objcct of thc to support 

through the system from encoder to decoder. Hie system additional processing an d parsing functions to minimize the 

layer contains timing information that requires constant load QD the host processor> such ^ clock rccovcry , tab i c 

delay. The clock references are Program clock reference filt ering, and error recovery. 

(PCR) and the time stamps are the Presentation Time .„ _ , , . , , . . , , 

Stamp/Decoding Time StampfFIS/DTS). , U 1S f sUlX fiirthe i ob J ect of me «™»*»>n to embed 

„ , , \ , frequently occurring functions in hardware using a single 

The decoder employs a local system clock having buffer for all data 

approximately the same 27 Megahertz frequency as the . it . V . e 

encoder. However, the decoder clock can not be allowed to " * » object of the invention to identify, 

free run. This is because it is highly unlikely that frequency jj ackets J r ^scrambling and forward those packets to a 

of the decoder clock would be exactly the same as the 3Q escramDier - 

frequency of the encoder clock. K is vet a further object of the invention to manager 

Synchronization of the two clocks is accomplished by the multiple queues in memory for delivery of transport stream 

Program Clock Reference (PCR) data field in the Transport data * 

Stream adaptation field. The Program Clock Reference SUMMARY OF THE INVENTION 

values can be used to correct the decoder clock. Program 35 

Clock Reference, or PCR, is a 42bit field. It is coded in two These and other objects are achieved by the method and 

parts, a PCR Base having a 33 -bit value in units of 90 kHz, apparatus of our invention. According to our invention it is 

and a PCR extension having a 9-bit extension in units of 27 possible to demultiplex the incoming data stream according 

MHz, where 27 MHz is the system clock frequency. to the embedded instructions in the System Layer, breaking 

As a general rule, the first 33bits of the first PCR received 40 the data stream into individual components that are passed 
by the decoder initialize the counter in a clock generation, to an audio decoder, a video decoder, or system memory, 
and subsequent PCR values are compared to clock values for while extracting program clock references (PCRs) from the 
fine adjustment. The difference between the PCR and the data stream, filtering out unnecessary streams through the 
local clock can be used to drive a voltage controlled use of Packet Ids (PIDs). This is accomplished while sup- 
oscillator, or a similar device or function, for example, to 45 porting additional processing and parsing functions to mini- 
speed up or slow down the local clock. mize the load on the host processor, such as clock recovery, 

Audio and video synchronization is typically accom- table filtering, and error recovery, and embedding frequently 

plished through the Presentation Time Stamp (PTS) inserted occurring functions in hardware using a single buffer for all 

in the Packet Elementary Stream (PES) header. The Presen- data. 

tation Time Stamp is a 33-bit value in units of 90 kHz, where 50 These objects are accomplished in the transport demulti- 

90 kHz is the 27 MHZ system clock divided by 300, The plexor of our invention. This transport demultiplexer is 

PTS value indicates the time that the presentation unit adapted for demultiplexing an MPEG-2-compliant transport 

should be presented to the user. ! stream into system data streams, a video data stream, and an 

In digital video systems, such as MPEG-2 systems, DSS audio data stream. The demultiplexer has front end logic, a 

systems, DVB systems, HDTV systems, and the like, there 55 packet buffer, and data, video, and audio unloaders. The 

is a need to demultiplex the incoming data stream. As used front end logic receives transport stream input packets, and 

herein, demultiplexing includes parsing header fields for delivers the transport stream packets to the packet buffer, 

their data content. Typically, transport demultiplexers The packet buffer, in turn, delivers system data to the system 

receive the incoming data stream from a network module, data unloader, video data to the video unloader, and audio 

and break it into individual components that are passed to, 60 data to the audio unloader. 

e.g., an audio decoder, a video decoder, and a system The front end logic of the transport demultiplexer of the 

memory. These functions are related. Under host processor invention includes a packet synchronizer, a packet parser 

control there is provided a Network Interface and Transport having a packet ID (PID) filter, a clock recovery unit, an 

Demultiplex. The Transport Demultiplex demultiplexes the optional descrambler, and a packet loader. The back end 

input into a System Memory Input, an Audio Decoder Input, 65 logic of the transport demultiplexer of our invention 

and a Video Decoder Input. Because of real- time processing includes a buffer control and a data unloader, where the 

constraints and system bandwidth requirements, there is a buffer control has a data link to the packet buffer and to the 
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audio and video unloaders and to the data unloader. The The PACKET PARSER extracts data from the transport 

buffer control includes an arbiter, packet management, and packet header and adaptation field. The PID is one of these 

static RAM control. The data unloader includes table filters, fields. The PID is compared to active PIDs in the PID filter. 

CRC checkers, and queue controllers. If the matches one of the predefined values, the remaining 

5 fields are extracted and the packet is forwarded to the 

THE FIGURES descrambler interface which will* send filtered but scrambled 

The invention may be understood by reference to the data to a descrambler, if present. The descrambler, if present, 

Figures descrambles and reconstructs the packets as configured by 

FIG. 1 denominated Prior Art, shows the packet multi- Jbe applicaUon. The resulting stream is oplionaUy forwarded 

plexing of the transport stream. 10 t0 a " auxUlar y P ort P rovides means for other devlces 

_ ° . . , ... to obtain access to the data. 

FIG 2 denominated "Prior Art" .shows ; a ^schematic view concurrently, the packet parser sends PCRs from match- 

of the transport packet stream with a 88 byte packet, . 4 . pcR ^ (0 ^ dock feco ^ for reconstnlct . 

byte header, an optional adaptation field and pay load, the . ^ s Time ^ (STC) 

payload being present if the adaptation field is less then 184 ° t : t ^ . . c 

f : 15 Status indicators representing parsed information are sent 

y * . . along with the complete transport packet to the packet loader 

FIG. 3, denominated "Prior Art", is a schematic view of to be stored ^ me packet buffer ^ packet buffer holds a 

the MPEG-2 system structure showing the system decoder, for examplc ^ {Q teQ Qr morC) tmapoti packcts 

i.e., a demultiplexer, demultiplexing the incoming bitstream while lhey are moved to the decoders ^ the DRAM or 

into an audio compression layer for an audio buffer and 20 othcr mcmory ^ packct buffer cfficicntly absorbs any 

decoder, a video compression layer for a video buffer and latency of these data { u 

decoder, and PCR data for clock control. The transport COfe ^ unloaders> „ audio 

FIG. 4, denominated "Prior Art", is a schematic view of unloader, a video unloader, and a data unloader. The audio 

the PES (packetized elementary stream) structure according unloader and the video unloader send data to the respective 

to the MPEG-2 Standard, showing the PES header. The 25 decoders as the data is requested. The data unloader sends 

FIGURE shows the PES header broken into its separate dala t0 a con t ro lter for subsequent transfer to system 

fields, with a further breakdown of the Optional Header memory. The mcmory unloader can also be set up to filter 

field, and a still further breakdown of the Extension field tabJe sec tions and perform crc checking of section data, 

within the OpUonal Header field. According to the invention the transport demultiplexer 

FIG. 5, denominated Prior Art shows the relationship of 30 accepts either parallel or serial data, detects the synchroni- 

the layering of the access units, the PES packets, and the zation character in the datastream, and establishes transport 

Transport Stream (TS) packets, with the encapsulation of packet boundaries therefrom. In the case of serial input, 

elementary stream data into transport stream packets. where only a bit clock is provided, the transport demulti- 

FIG. 6 shows the dataflow of the transport demultiplexer plexor of the invention establishes byte alignment, 

of the invention. If the transport loses synchronization and the packet 

FIG. 7 shows the data flow under the control of a host buffer doesn't contain any packets for the audio and video 

processor controller, with the transport deraultiplexor of the decoders, an error is signalled to the appropriate decoder so 

invention, and with network input demultiplexed into that it can mask the error appropriately, 

system, audio data, and video data. 4Q The status of the Sync block is reported with the InSync 

FIG. 8 shows the use of the transport demuluplexor of the bit of the Status Register, 

invention in a system environment. The Packet Parser extracts transport error indicator infor- 
mation from each packet, as well as the packet boundary 

DETAILED DESCRIPTION OF THE information, and sends it to other units to assist in their 

INVENTION ^ processing. Some of the parsed information is stored in the 

The MPEG-2 transport bitstream is a set of time division packet buffer along with the packet for use by the unloaders. 

or packet multiplexed bitstreams. Each such time division or If the packet detects the Transport Error Indicator is set, 

packet multiplexed bitstream may contain a plurality of or that the sync byte is missing and the sync drop is greater 

programs, that is, television channels, digital then 0, or that the TS Error Signal is active, the packet is 

communications, or the like. Each bitstream contains a so discarded. The Transport Packet Header, shown in FIG. 2 

systems stream which provides systems layer functions for has a plurality of fields. One of the fields is a one bit 

one or more audio and video elementary streams in the time Transport Error Indicator. Any packet with the Transport 

division or packct multiplexed single stream. The single Error Indicator set to 1 is discarded. If the error occurred in 

stream is as shown in FIGS. 1 to 5, denominated "Prior Art", a packet which would have matched a PID Filter entry, the 

where many packets make up the single bitstream. The ss continuity count check will mark the error in the next valid 

single bitstream is a system layer. As shown generally in packet of the PID so that it can be masked by the decoders 

FIGS. 1 to 5, and with specificity in FIG. 2, the first level of or managed by the memory unloader. Thus, errors in packets 

granularity is a transport layer, made up of a 4 byte header, which do not match entries in the PID Filter do not generate 

an optional adaptation field, and a payload (the payload is up unnecessary events for the system to handle, 

to to 184 bytes if the adaptation field is less then 184 bytes). 60 The value of the Payload Unit Start Indicator bit is 

In turn, at the next level of granularity, each packet is made forwarded to the unloaders through the packet buffer for use 

up of a packet header, and packet payload data bytes, which during packet unload. 

may be PES packets, table sections, or private data. The The packet parser incorporates a PID filter, such as a 32 

single bitstream is a system layer. entry PID filter. The 13 bit PID value is sent to the PID filter 

FIG. 6 represents the dataflow of transport stream data 65 to determine if a match occurs. Packets that match a PID 

through the transport demultiplexer of the invention. The entry filter are forwarded, while all other packets, including 

SYNC block determines the start of the transport packet. null packets, are discarded. 
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The transport demultiplexer of the invention further pro- The continuity field count in non-pay load packets is not 

vides PID filtering. The PID filter registers and a corre- checked as defined by the MPEG standard. This is because 

sponding PID enable register are used to control which the continuity count is used to insure integrity of the paylo ad 

packets are forwarded through the transport demultiplexer. d a t a . 

APID value should ordy appear once in the PID filter TThere s Th c syntax of mc Adaptation Field is shown in FIG. 2. 

are up to 32 programmable PID values that are used to filter the Adaptation Field are of special interest, 

the transport stream. The PID filter associates a PID index, „ , AJ . f. c . ... - s. . t 

for example, a 5 bit PID index, with each of the 32 PID For C ^P^ the Adaptation Field Length field indicates the 

entries. One PID index is reserved for the video PID, and n ™* r of ^ ? adaptaUon field following tois field If 

one for the audio PID. The other PID entries are defined by in mc , AdaptaUon Field Length Field is greater than 00, then the 

the application Adaptation Field Flags are defined. The adaptation field 

Thc front-end PID filtering logic filters incoming trans- leD S th * ^ b ? me unloaders to determine the start of the 

port packets before they are placed in the packet buffer. Data payload, and to deliver the Adaptation Field to the Dram or 

from the PIDs, for example, data from up to about 32 other memory queues as configured by the application 

different PIDs can be captured by the transport core or processor. 

transport demultiplexer of the invention for delivery to the 15 The first field in the Adaptation Fields is the 1-bit Dis- 

output ports. All other packets, including null packets, may continuity Indicator, This flag indicates two different types 

be discarded. of discontinuity, continuity counter and system time base. 

A plurality of registers, for example, thirty two registers, The discontinuity indicator in the PCR PID indicates a 

are used to assign a PID index to each of the filtered packets discontinuity in the system time base. The PCR, if present, 

to be delivered downstream, for example, to a descrambler 20 is loaded into the STC. A system time base discontinuity is 

and/or a decoder and/or a Packet Buffer. A PCR PID register also signalled to the decoders on the first video or audio 

holds the PCR PID value which can be the same or different packet following the discontinuity. The application or host 

from any of the general PID filter indices. If the PCR PID processor can be interrupted upon the arrival of a disconti- 

is not the same as one of the PID filter entries, then the PCR nuity indicator. 

PID entries are not forwarded. Moreover, since the PCR PID The next field in the Adaptation Fields is the 1-bit random 

filter is separate from the general PID filters, the STC can be access indicator. The audio and video PIDs can be config- 

started before the transport begins delivering data to the ured to interrupt the host processor or assist processor upon 

decoders. the arrival of the random access indicator. 

When the datastream is scrambled, as would be the case 3Q The PCR fields are forwarded to the Clock Recovery Unit, 

for a scrambled European Telecommunications Standards ^ s ^ point m fa d ^ ^ hos( can be 

Institute Digital Vtdeo Broadcasting (ETSI DVB) compliant ^ £ * n me arriv S of * splicing point 

stream, the two bit Transport Scrambling Control bits are _ _ ^ , , , 

extracted and sent to the descrambler, if present. 11,6 Transport Pnvate Data Flag can interrupt the host 

rrm , i ■ , a j * 4^ p. , , n 4 , p" u • j * processor and the transport demultiplexer upon the arrival of 

The two bit Adaptation Field Control Field is used to„ r . lC1JJt x , r *i_ V* *i_ 

determine if an adaptaUon field and/or a payload is present. P nvate field «tota Moreover the Dram or other memory 

T „ j . « j . llL , c ./ . queues can be configured to forward the adaptation pnvate 

If an adaptation field is present, the adaptation field parsing ^ g memor 

described hereinbelow is performed. Packets with an adap- a a 0 svs em memorv - 

tation field control value of "00" arc discarded. A value of ^ transport demultiplexor can include an ETSI DVB, or 

"01" indicates that there is no adaptation field, only payload. 4Q other descrambler. Tne descrambler implements the appro- 

A value of "10" indicates that there is an adaptation field P nate descrambhng algorithm, for example ETSI DVB. The 

only, and no payload, while a value of "11" indicates that host application and/or the transport stream can configure 

there is an adaptation field followed by payload. several contro1 fields t0 contral descrambling for each PID 

The 4-bit Continuity Counter field is maintained for each mdcx ; ™° DescrambUng Control Fields for each PID index 

enabled PID index to detect any missing data in the payload 45 l ^ , I ^ ™ b ?. d Pf**? 18 of 

stream. The Continuity Counter is incremented on each PID index are to be descrambled KeylD , which indicates 

incoming packet with a payload. This 4-bit counter wraps ^Sf!^^ \° n^l P*^" J™ index ' 

around to 0x0 after it reaches OxF. The value of the a ?. d PLS £ rS m *™ ics A ?E i°! TS lc ^ cl d f cram / 

continuity counter maintained by the hardware is compared ^ fo ' the particular PID index. To be noted is that both 

to the incoming packets. If the values do not match, a PID so PES ™ d J* lc ? and descrambling can be 

stream error is signaled. enabled ' ^ [ho ^ not simultaneously for the same PID. 

However, there are two situations where a PID stream ^ contro1 word P aire > for example, eight control word 

error is not signaled. First, an error is not signaled if the P aiIS > can be shared amon & me PIDs ' for example, among 32 

discontinuity indicator in the adaptaUon field is set. In this PIDs - A ke y ID > for example, a 3 bit keylD in the case of a 

case, the break in continuity is expected. Second, if two 55 set of 8 control word pairs, can be associated with each PID 

consecutive packets in the transport stream with the same to indlcate wmch conlro1 word P air the descrambler will use 

PID have the same continuity counter value, an error is not for P ackets of that P1D Each C0Dlrol word P air conlains an 

signaled. This is because in this case one packet is a od d key and an even key. 

duplicate of the other. If there is no error in the first packet, The descrambler, when present, maintains a constant 

the second packet is discarded. If, however, there is an error 60 delay, so that the descrambled data can be delivered with 

in the first packet, it is discarded and the second packet is constant delay to an output port. The scramble control bits 

loaded into the packet buffer. are modified by the descrambler for packets which are 

A continuity count error is handled as a PID stream error descrambled. Packets which are not configured for descram- 

and is forwarded to the unloaders by setting the error bit in olin g are sent through an alternative data path and recom- 

the packet flags field stored with the packet in the packet 65 bine d after the descrambler. 

buffer. The error can also signal an interrupt to the applica- The descrambler can share resources with the transport 

tion processor. demultiplexor. These shared resources can include the appli- 
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cation processor interface, the Interrupt Queue register for stream. Those sections that do not pass the CRC check are 

reporting error conditions, and a logical memory array. discarded, and the application optionally notified. 

The descrambler reports an error when a scrambled The transport demultiplexor of the invention transfers 

packet is received but descrambling for that FID index is incoming packets, including portions thereof, to a system 

disabled; or a transport packet contains a combination of S memory. This transfer is accomplished using independent 

PES header and adaptation field that is not permitted under queues, for example one independent queue for each PID 

the applicable descrambling standard, such as both a PES index, that is, thirty two independent queues. Each queue 

header and an adaptation field that is not permitted by the can be customized, for example by the application, to adjust 

ETSI DVB Standard; the scramble control bits are not the size of a circular buffer and to set thresholds for 

permitted by the applicable descrambling standard, such as 10 interrupts and the application read pointer. For tables the 

"01" which is not permitted under the ETSI DVB Standard; application can be interrupted after a complete section has 

or the transport packet scramble control bits are not "00" in been successfully transferred into system memory, 

a PK) index configured for PES packet descrambling. The transport demultiplexor of our invention can support 

These errors are reported as an interrupt to the host a plurality of queues in memory. According to a particularly 

application. The host application can determine which type 15 preferred exemplification, which is MPEG-2 compatible, the 

of errors have occurred by reading the descrambler status transport core supports up to 32 queues in memory. Each of 

register. In a preferred exemplification of our invention, the these queues is associated with a PID Index in the PID filter, 

descrambler status bits are cleared by writing the register For example, data from PID Index 5 can be stored in 

with l's in the corresponding bit position to be cleared, memory Queue 5. One memory queue can be allocated to 

allowing bits to be separately cleared. provide special functions. 

The transport demultiplexor of the invention also supports The starting address of the memory queue region is 

both Transport Level and PES level descrambling. In this specified by the DRAMBase register. The queue region of 

application the control word registers and other registers in memory is memory aligned. Each memory queue is speci- 

the descrambler section of the transport demultiplexor are fied as a continuous memory region, typically allocated in 

added to the address range of the application processor 4096 byte blocks, although larger or smaller blocks may be 

interface. 25 utilized without departing from our invention, within the 

The transport demultiplexor of the invention provides a total memory queue region. A single memory queue can be 

set of data processing functions. In a preferred embodiment configured to be as large as the entire memory queue region, 

these data processing functions do not require host processor The memory queues can be configured to reset when a 

support for handling individual packets. PID filter entry is written. This is accomplished by setting a 

The transport demultiplexor parses the individual fields in 30 corresponding bit in the DRAMRegisters register for that 

the transport header and the adaptation fields as part of the PID index. For example, when the DRAM Resets bit for the 

PID filtering, above, clock recovery, and error handling PID is "Not Set" and the PID filter entry is updated, any 

functions, so that PID values, error indicators, continuity packets of this PID Index in the packet buffer are flushed, 

counter exceptions, discontinuity indicators, and the like, When the DRAM Resets bit for this PID is "Set" and the PID 

can be quickly reported to the application processor. 35 filter entry is updated, any packets of this PID Index in the 

The transport demultiplexor facilitates error handling, packet buffer are flushed, the Memory Queue is configured 

channel changes, and time base (STC) changes by using a 10 be resel when first . P acke } of ^ new PID * processed, 

compressed data connection to communicate directly with and any old interrupts in the interrupt fifo associated with 

the decoders. The transport demultiplexor automatically this PID Index are flushed when the PID Filter entry is 

detects and flags errors in the datastream. This allows the 40 written. 

decoders to mask the error and recover without host system Updates to the audio and video PID Filter registers behave 

intervention. Similarly, channel changes are initiated in the the same way as updating any other entry. Performing the 

transport demultiplexor with a minimum of setup, that is, update as part of an audio and video channel change delays 

changing the PID entry, and the stream changes are inter- the actions described above until the Audio or Video Chan- 

nally coordinated directly with each decoder, allowing fast 45 nel Change register is copied to the corresponding entry in 

and efficient channel switching. Changes in the time base, the PID filter. 

that is, the STC, either as part of a channel change or due to Moreover, the entire memory region does not need to be 

a time base discontinuity, are marked and flagged in the allocated solely for the memory queues. The memory queue 

stream to allow the decoders to correctly synchronize updat- or queues can be placed anywhere within the memory queue 

ing the internal STC with respect to the data. 5Q region and the remainder of the Memory queue region can 

Data is received by the transport demultiplexor and con- be used for other purposes, 

verted to be addressable in tabular form. Entire table sec- Each of the Memory queues can be configured 

tions are written to DRAM or other memory including the independently, with registers specifying the start and stop 

Table ID through the last byte, where the last byte is as addresses of each Memory queue. Preferably queue regions 

specified in the section length field. This capability provides are non-overlapping. Memory queue memory management 

the application or host processor full flexibility in interpret- 55 also includes the use of pointers or registers to determine 

ing the table. how much data has been written to each Memory queue. 

One aspect of the table processing of the transport demul- One pointer or register indicates the next address within the 

tiplexor of the invention is table section filtering before Memory queue where data will be written, indicating the 

memory storage of the tables. Table filtering before memory start of the current table section which is being delivered, 

storage by the transport demultiplexor reduces the load on 60 In the case of system data, the Memory unloader provides 

the application processor by filtering table sections before automatic error handling for table sections. For all types of 

sending them to DRAM or other memory. Filtering reduces system data the transport demultiplexor notifies the proces- 

the application processor work load for parsing table sec- sor through an interrupt if a PID stream error occurred on 

tions and the required size of working areas in DRAM or data delivered to the memory. The front-end units discard 

other memory to manage table data. 65 packets with errors before the error-containing packets are 

The transport demultiplexor of the invention checks the loaded into the packet buffer. This is because an error may 

CRC value of table sections against the value coded in the make it impossible to correctly parse the packet. Additional 
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checking is performed by the Memory unloader on table 
sections to ensure that the table section length matches the 
value in the table section header. If any type of error is found 
while unloading a table section, the current section is 
discarded and a Memory queue Write Pointer is moved back 
to the end of the previous valid section. 

While packet buffer overflows are unlikely, should a 
packet buffer overflow occur, the transport demultiptexor of 
the invention handles the packet buffer overflow by identi- 
fying which PID streams were affected and handles the 
errors the same way a missing packet error is handled. 

While the embodiments and exemplifications of our 
invention have been described and illustrated with respect to 
one particular standard, the MPEG-2 Standard, it is, of 
course to be understood the methods and apparatus of our 
invention can be used with other time division multiplexed 
and packet multiplexed data streams, having packetized 
headers and data, including, by way of example, the Euro- 
pean Teleocmmunications Standards Institute (ETSI) Digital 
Video Broadcasting (DVB) standard, the High Definition 
Television (HDTV) standard, and the Direct Satellite Sys- 
tem (DSS) standard, among others. 

While the invention has been described with respect to 
certain preferred embodiments and exemplifications, it is not 
intended to limited to scope the invention thereby, but solely 
by the claims appended hereto. 

We claim: 

1. A transport demultiplexer for demultiplexing a trans- 
port stream into a system data stream, a video data stream, 
and an audio data stream, said transport demultiplexer 
comprising: 

a) front end logic; 

b) a packet buffer; 

c) a video unloader; 

d) a data unloader for unloading and queueing system 
data; and 

e) an audio unloader; 

said front end logic receiving transport stream input 
packets, and delivering said transport stream packets to 
the packet buffer, and said packet buffer delivering 
system data to the data unloader, video data to the video 
unloader, and audio data to the audio unloader, wherein 
said front end logic comprises a packet parser having a 
packet ID filter, and a packet loader; and 

further including a buffer control, wherein said buffer 
control has a data link to said packet buffer and to said 
data unloader, wherein said buffer control includes an 
arbiter, a queue manager, and a static RAM controller. 

2. A transport demultiplexer for demultiplexing a trans- 
port stream into a system data stream, a video data stream, 
and an audio data stream, said transport demultiplexer 
comprising: 

a) front end logic; 

b) a packet buffer; 

c) a video unloader; 

d) a data unloader for unloading and queueing system 
data; and 

e) an audio unloader; 

said front end logic receiving transport stream input 
packets, and delivering said transport stream packets to 
the packet buffer, and said packet buffer delivering 
system data to the data unloader, video data to the video 
unloader, and audio data to the audio unloader; 

further including a buffer control, wherein said buffer 
control has a data link to said packet buffer and to said 
data unloader, wherein said buffer control includes an 
arbiter, a queue manager, and a static RAM controller; 
and 
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wherein said data unloader includes at least one of a 
table filter, CRC check, and queue control. 

3. A transport demultiplexer for demultiplexing a trans- 
port stream into a system data stream, a video data stream, 
and an audio data stream, said transport demultiplexer 
comprising: 

a) front end logic; 

b) a packet buffer; 

c) a video unloader; 

d) a data unloader; and 

e) an audio unloader; 

said front end logic receiving transport stream input 
packets, and delivering said transport stream packets to 
the packet buffer, and said packet buffer delivering 
system data to the data unloader, video data to the video 
unloader, and audio data to the audio unloader; and 

further including a buffer control, wherein said buffer 
control has a data link to said packet buffer and to said 
data unloader, wherein said data unloader includes a 
table filter, a CRC check, and a queue control. 

4. A transport demultiplexer for demultiplexing a trans- 
port stream into a system data stream, a video data stream, 
and an audio data stream, said transport demultiplexer 
comprising: 

front end logic for receiving transport stream input pack- 
ets; 

a single port packet buffer for receiving said transport 

stream packets from said front end logic; 
a video unloader; 

a data unloader for unloading and queueing system data; 
an audio unloader; 

wherein said packet buffer delivers system data to the data 
unloader, video data to the video unloader, and audio 
data to the audio unloader; 

a buffer control, said buffer control having a data link to 
said packet buffer and to said data unloader, wherein 
said buffer control comprises an arbiter for controlling 
access to said single port packet buffer; and 

wherein said data unloader includes at least one of a table 
filter, CRC check, and queue control. 

5. The transport demultiplexer of claim 4, wherein said 
packet buffer comprises multiple queues, and wherein said 
buffer control further comprises queue management means 
for sorting packets of said transport stream into system data, 
video data and audio data for storage in separate queues of 
said multiple queues of said packet buffer. 

6. The transport demultiplexer of claim 5, wherein said 
queue management means further includes means for track- 
ing an order in which said system data, video data and audio 
data are received at said packet buffer. 

7. The transport demultiplexer of claim 5, wherein said 
buffer control further includes a static RAM controller. 

8. A transport demultiplexor for demultiplexing a trans- 
port stream into a system data stream, a video data stream, 
and an audio data stream, said transport demultiplexor 
comprising: 

front end logic for receiving transport stream input pack- 
ets; 

a single port packet buffer for receiving said transport 

stream packets from said front end logic; 
a video unloader; 

a data unloader for unloading and queueing system data; 
an audio unloader; 

wherein said packet buffer delivers system data to the data 
unloader, video data to the video unloader, audio data 
to the audio unloader; 
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a buffer control, said buffer control having a data link to 
said packet buffer and to said data unloader, wherein 
said buffer control comprises arbiter means for con- 
trolling access to said single port packet buffer; and 

wherein said front end logic comprises a packet parser 
having a packet ID filter, and a packet loader. 

9. A transport demultiplexor for demultiplexing a trans- 
port stream into a system data stream, a video data stream, 
and an audio data stream, said transport demultiplexor 
comprising: 

front end logic for receiving transport stream input pack- 
ets; 

a packet buffer for receiving said transport stream packets 

from said front end logic; 
a video unloader; 

a data unloader for unloading and queueing system data; 
an audio unloader; 

wherein said packet buffer delivers system data to the data 
unloader, video data to the video unloader, and audio 
data to the audio unloader; 

a buffer control, said buffer control having a data link to 
said packet buffer and to said data unloader, wherein 
said buffer control comprises at least one of an arbiter 
or queue manager for said packet buffer; and 

wherein said data unloader includes at least one of a table 
filter, CRC check, and queue control. 

10. The transport demultiplexor of claim 9, wherein said 
buffer control comprises said queue manager, and wherein 
said packet buffer comprises multiple queues, said queue 
manager comprising means for sorting packets of said 
transport stream into system data, video data and audio data 
for storage in separate queues of said multiple queues of said 
packet buffer. 

11. A transport demultiplexor for demultiplexing a trans- 
port stream into a system data stream a video data stream, 
and an audio data stream, said transport demultiplexor 
comprising: 

front end logic for receiving transport stream input pack- 
ets; 

a packet buffer for receiving said transport stream packets 

from said front end logic; 
a video unloader; 

a data unloader for unloading and queueing system data; 
an audio unloader; 

wherein said packet buffer delivers system data to the data 
unloader, video data to the video unloader, and audio 
data to the audio unloader; and 

wherein said data unloader comprises table filter means 
for filtering data retrieved from said packet buffer, and 
further includes at least one of a CRC check and queue 
control. 

12. A transport demultiplexor for demultiplexing a trans- 
port stream into a system data stream, a video data stream, 
and an audio data stream, said transport demultiplexor 
comprising: 

front end logic for receiving transport stream input pack- 
ets; 

a packet buffer for receiving said transport stream packets 

from said front end logic; 
a video unloader; 

a data unloader for unloading and queueing system data; 
an audio unloader; 

wherein said packet buffer delivers system data to the data 
unloader, video data to the video unloader, and audio 
data to the audio unloader; 
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a buffer control, said buffer control having a data link to 
said packet buffer and to said data unloader, wherein 
said buffer control comprises at least one of an arbiter, 
queue manager, and static RAM controller; and 

wherein said data unloader includes at least one of a table 
filter, CRC check, and queue control. 

13. A transport demultiplexor for demultiplexing a trans- 
port stream into a system data stream, a video data stream, 
and an audio data stream, said transport demultiplexor 
comprising: 

front end logic for receiving transport stream input pack- 
ets; 

a packet buffer for receiving said transport stream packets 

from said front end logic; 
a video unloader; 
a data unloader; 
an audio unloader; 

wherein said packet buffer delivers system data to the data 
unloader, video data to the video unloader, and audio 
data to the audio unloader; and 

wherein said data unloader includes at least one of a table 
filter, CRC check, and queue control. 

14. A transport demultiplexor for demultiplexing a trans- 
port stream into a system data stream, a video data stream, 
and an audio data stream, said transport demultiplexor 
comprising: 

front end logic for receiving transport stream input pack- 
ets; 

a packet buffer for receiving said transport stream packets 

from said front end logic; 
a video unloader; 

a data unloader for unloading and queueing system data; 
an audio unloader; 

wherein said packet buffer delivers system data to the data 
unloader, video data to the video unloader, and audio 
data to the audio unloader; 

a buffer control, said buffer control having a data link to 
said packet buffer and to said data unloader, wherein 
said buffer control comprises at least one of an arbiter 
or queue manager for said packet buffer; and 

wherein said front end logic comprises a packet parser 
having a packet ID filter, and a packet loader. 

15. A transport demultiplexor for demultiplexing a trans- 
port stream into a system data stream, a video data stream, 
and an audio data stream, said transport demultiplexor 
comprising: 

front end logic for receiving transport stream input pack- 
ets; 

a packet buffer for receiving said transport stream packets 

from said front end logic; 
a video unloader; 

a data unloader for unloading and queueing system data; 
audio unloader; 

wherein said packet buffer delivers system data to the data 

unloader, video data to the video unloader, and audio 

data to the audio unloader; 
wherein said data unloader comprises table filter means 

for filtering data retrieved from said packet buffer; and 
wherein said front end logic comprises a packet parser 

having a packet ID filter, and a packet loader. 



11/19/2003, EAST Version: 1.4.1 



